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Weapon  systems  must  provide  a  needed  capability,  meet  user  needs  as  evidenced  by  opera¬ 
tional  effectiveness  and  operational  suitability,  and  must  be  affordable.  While  operational 
effectiveness  addresses  the  degree  of  mission  accomplishment  in  the  intended  environment, 
operational  suitability  addresses  the  degree  to  which  a  system  can  be  satisfactorily  placed  in 
use,  given  reliability,  availability,  maintainability  (RAM),  supportability,  and  ownership  cost, 
among  other  factors.  These  requirements  are  tested  and  quantified  prior  to  fielding  by  the  initial  operational 
test  and  evaluation  (IOT&E)  process,  and  assessed  against  defined  criteria.  As  illustrated  in  Figure  1,  total 
ownership  costs  (TOC)  incurred  during  the  operations  and  support  (O&S)  phase  may  constitute  65  percent 
to  80  percent  of  total  life  cycle  cost  (LCC). 


How  then  do  we  address  the  problem  of  high  TOC  while  still  meeting  the  warfighter's  requirements?  We  do  so  by  focusing  on 
the  causes  of  high  TOC  in  both  system  design  (quality)  and  logistics  footprint  (quantity).  This  includes  the  application  of  skills 
and  processes  in  the  areas  of  RAM,  supportability,  and  supportability  analysis  as  part  of  the  revitalized  systems  engineering 
processes  required  by  the  2009  Weapon  Systems  Acquisition  Reform  Act  (WSARA). 


Dallosta  is  the  performance  learning  director  for  reliability,  availability,  maintainability,  and  supportability  at  the  DAU  Center  for  Logistics  and  Sustainment. 
Simcik  is  the  performance  learning  director  for  life  cycle  management  integration  at  the  DAU  Center  for  Logistics  and  Sustainment. 
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Supportability  Analysis  Framework 

Supportability  measures  the  degree  to  which  a  system  can  be 
supported  both  in  terms  of  its  inherent  design  characteristics 
of  reliability  and  maintainability  and 
the  efficacy  of  the  various  elements 
of  product  support,  to  include  the 
spare  parts,  tools,  and  training  re¬ 
quired  to  operate  and  maintain  it. 


maintainability  as  design  parameters  and  their  role  in  meeting 
operational  effectiveness  and  suitability  requirements.  The 
second  component,  the  supply  chain  model  (SCM)  focuses  on 


Supportability  analysis  is  a  structured 
methodology  to  ensure  the  system  is 
designed  for  supportability  and  the 
product  support  elements  are  iden¬ 
tified  and  available  to  the  user.  The 
affordable  system  operational  effec¬ 
tiveness  (ASOE)  model  addresses 
the  contributions  of  both  system  de¬ 
sign  (quality)  and  logistics  footprint 
(quantity)  to  total  ownership  cost. 

The  ASOE  model  comprises  two 
components.  System  design  for  op¬ 
erational  effectiveness  (SDOE)  fo¬ 
cuses  on  the  impact  of  reliability  and 
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Figure  2.  Reliability,  Availability, 
Maintainability — Life  Cycle  Cost  1 'rade  Space 


Figure  3.  Supportability  Analysis  Life  Cycle  Framework 
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the  logistics  activities  that  enable  effective  sustainment.  (A  full 
description  is  provided  in  Designing  and  Assessing  Supportability 
in  DOD  Weapon  Systems.  A  Guide  to  Increased  Reliability  and 
Reduced  Logistics  Footprint ,  available  at  the  Acquisition  Com¬ 
munity  Connection  website.) 

Together,  the  two  models  define  a  RAM/LCC  trade  space,  as 
illustrated  in  Figure  2.  The  trade  space  bounds  the  values  of  re¬ 
liability  and  sustainment  cycle  time  to  achieve  the  lowest  LCC. 
The  balancing  is  conducted  throughout  the  life  cycle  to  ensure 
an  optimized  solution.  While  early-phase  considerations  may 
exhibit  higher  R&D  and 
acquisition  costs  due  to 
the  cost  of  implement¬ 
ing  RAM  programs,  the 
reduction  in  O&S  costs 
due  to  the  improved  per¬ 
formance  and  decreased 
sustainment  costs  far 
outweighs  implementa¬ 
tion  costs. 

Cumulatively,  the  models 
define  the  supportability 
and  supportability  analy¬ 
sis  activities  conducted 
collaboratively  by  the  sys¬ 
tems  engineering  and  life 
cycle  logistics  domains, 
and  provide  a  powerful 
and  effective  means  of 
ensuring  life  cycle  suit¬ 
ability  for  O&S. 


The  Supportability  Analysis  Life  Cycle  Frame¬ 
work  in  Figure  3  identifies  key  supportability 
analysis  activities  and  their  relationships,  and 
serves  as  the  framework  for  this  process.  The 
framework  is  described  in  terms  of  three  dis¬ 
tinct  yet  integrated  processes. 

Design  for  Support 

Decisions  made  up  front  during  the  early 
phases  have  a  profound  effect  on  life  cycle 
cost.  As  illustrated  in  Figure  4,  design  deci¬ 
sions  made  by  Milestone  B  establish  a  "cost 
commitment"  of  approximately  70  percent  of 
a  system's  LCC,  while  actual  "cost  expended" 
values  are  still  a  small  percentage  of  total 
expenditures. 

"Design  for  support"  activities  begin  at  the 
earliest  life  cycle  phase  when  user  needs  are 
identified,  capabilities  defined,  and  priorities 
established.  During  this  phase,  supportability 
objectives,  their  associated  metrics,  and  the 
initial  trade  studies  are  conducted  within  the 
systems  engineering/life  cycle  logistics  process  and  result  in 
the  preferred  system  design  and  sustainment  architectures 
with  specific  design  criteria. 

Key  to  these  activities  is  the  development  of  the  maintenance 
concept,  which  specifies  the  levels  of  maintenance  and  their 
capabilities  and  assigns  the  preventive  and  corrective  tasks  to 
be  accomplished  at  each  level.  The  maintenance  concept  pro¬ 
vides  the  construct  by  which  systems  engineering/life  cycle 
logistics  tasks  are  conducted.  The  tasks  include  reliability  and 
maintainability  (R&M)  modeling,  prediction,  allocation  and 
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analysis;  failure  mode,  effects  and  criticality  (FMECA);  fault 
tree  analysis  (FTA);  and  condition-based  maintenance  plus 
(CBM+),  and  reliability  centered  maintenance  (RCM). 

The  output  of  these  tasks  is  the  assessment  of  the  impact 
of  the  system's  R&M  design  characteristics  on  performance 
and  sustainment.  Improvements  in  RAM  are  achieved  by  the 
elimination  of  single  points  of  failure,  improved  mean  time  be¬ 
tween  failure  (MTBF)  through  the  use  of  redundancy,  and  the 
reduction  of  mean  time  to  repair  (MTTR),  through  the  imple¬ 
mentation  of  accessibility,  modularity  and  testability  concepts. 
Overall  reductions  in  maintenance  are  also  achieved  by  CBM+ 
and  RCM  programs  that  focus  on  conducting  maintenance 
based  on  the  evidence  of  need  rather  than  defined  schedules. 

From  both  a  cost  and  logistics  perspective,  the  level  of  repair 
analysis  (LORA)  is  the  most  important  business  decision  made 
in  the  program  office.  The  LORA  uses  the  detailed  mainte¬ 
nance  information  provided  by  the  maintenance  task  analysis 
(MTA),  as  well  as  operational  factors  and  economic  criteria 
to  allocate  the  repair/disposal  actions  throughout  the  levels 
of  maintenance,  and  to  provide  an  LCC  estimate  for  use  in 
decision  making.  The  LORA  provides  the  information  needed 
to  finalize  the  maintenance  concept  as  well  as  initiate  main¬ 
tenance  planning  activities. 

Design  the  Support 

The  "design  the  support"  process  is  based  on  the  output  of  the 
design  for  support  process  as  described  previously— i.e.,  the 
spares,  common,  peculiar,  and  unique  tools  and  discrete  and 
automatic  test  equipment,  facilities,  and  maintenance  training 
that  must  be  specified  and  procured.  For  example,  support 
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evidence  of  need  rather  than 
defined  schedules. 
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equipment  recommendation  data  (SERD)  is  generated  as  part 
of  the  product  support  analysis  (PSA)  process  to  specify  mea¬ 
surement  requirements  and  determine  if  existing  equipment 
can  be  used  or  whether  new  equipment  must  be  designed 
and  procured.  A  properly  tailored  product  support  package, 
based  on  the  technical  requirements  of  the  system,  will  yield 
the  most  affordable  and  operationally  ready  capability. 

The  DoDI  5000.02  acquisition  process  includes  the  prelimi¬ 
nary  design  review  (PDR)  and  the  critical  design  review  (CDR) 
to  ensure  requirements  are  defined,  traceable  throughout  the 
design  and  that  governance  evaluates  the  effective¬ 
ness  of  their  implementation  and  the  implications 
on  performance,  cost,  schedule  and  sustainment. 
The  DoD  systems  engineering  process  uses  the  de¬ 
fense  acquisition  program  support  (DAPS)  method¬ 
ology  to  review  the  design  and  ensure  supportability 
metrics  are  defined,  implemented  in  the  design  as 
criteria,  and  that  the  design  reflects  their  impact  on 
the  system  in  meeting  performance  and  sustain¬ 
ment  requirements. 


DAPS  provides  the  tailorable  framework  for  con¬ 
ducting  program  reviews  to  assist  program  man¬ 
agers  and  DoD  decision  makers  in  preparation  for 
milestone  decision  reviews.  The  methodology  pro¬ 
vides  a  standardized  approach  to  conduct  program 
reviews,  and  allows  for  the  participation  of  a  broad 
cadre  of  subject  matter  experts. 

Chapter  9  of  the  Defense  Acquisition  Guidebook 
addresses  the  developmental  test  &  evaluation 
(DT&E)  and  operational  test  &  evaluation  (OT&E) 
processes  as  the  principal  methods  of  ensuring  the 
achievement  of  user  needs  as  expressed  in  key  per¬ 
formance  parameters  (KPPs). 


Figure  4.  Cost  Committed  vs.  Cost  Expended 
Curves 
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DT&E  provides  the  verification  and  validation  of  the  systems 
engineering  process  and  must  provide  confidence  that  the 
system  design  solution  is  on  track  to  satisfy  the  desired  capa¬ 
bilities.  Rigorous  component  and  sub-system  DT&E  enables 
performance  capability  and  reliability  improvements  to  be 
designed  into  the  system  early.  DT&E  events  should  advance 
to  robust,  system-level  and  system-of-systems  level  T&E,  to 
ensure  that  the  system  has  matured  to  a  point  where  it  can 
enter  production,  and  ultimately  meet  operational  employ¬ 
ment  requirements. 

OT&E  focuses  on  testing  the  system  in  its  intended  use  envi¬ 
ronment  where  two  primary  metrics  reign:  operational  effec¬ 
tiveness  and  suitability.  Operational  effectiveness  is  the  overall 
degree  of  mission  accomplishment  of  a  system  when  used  by 
representative  personnel  in  the  environment  planned  or  ex¬ 
pected  for  operational  employment  of  the  system  considering 
organization,  doctrine,  survivability,  tactics,  vulnerability,  and 
threat.  Operational  suitability  is  the  degree  to  which  a  system 
can  be  satisfactorily  placed  in  field  use,  with  consideration 
given  to  reliability,  availability,  compatibility,  transportability, 
interoperability,  wartime  usage  rates,  maintainability,  safety, 
human  factors,  manpower  supportability,  logistics  support- 
ability,  documentation,  training  requirements,  and  natural 
environmental  effects  and  impacts. 


terms  of  reliability  and  maintainability,  and  the  effectiveness  of 
the  product  support  infrastructure  and  sustainment  resources. 

Support  the  Design 

The  "support  the  design"  process  is  implemented  through  the 
resources  of  the  Integrated  Product  Support  (IPS)  Package,  as 
discussed  in  Appendix  A  of  the  DoD  Product  Support  Manager 
Guidebook  and  is  the  ultimate  outcome  of  the  supportability 
analysis  process.  As  shown  in  Figure  3,  the  12  IPS  elements 
are  defined  as  a  result  of  a  robust  product  support  analysis 
and  provide  the  assets  required  for  effective  sustainment  of 
the  system. 

Conclusion 

Weapon  systems  must  provide  a  needed  military  capability, 
meet  user  needs  as  evidenced  by  operational  effectiveness 
and  operational  suitability,  and  must  be  affordable.  Ensur¬ 
ing  affordability  starts  at  the  earliest  phases  of  a  system's 
life  cycle,  where  decisions  drive  acquisition  costs  and  essen¬ 
tially  lock  in  O&S  costs.  The  supportability  analysis  process 
provides  a  tool  that  can  be  collaboratively  used  by  the  systems 
engineering  and  logistics  domains  to  address  the  impact  of 
the  design  characteristics  of  reliability,  availability,  and  main¬ 
tainability  on  the  system  design  and  the  logistics  footprint  to 
achieve  program  outcomes. 


From  both  supportability  and  supportability  analysis  perspec¬ 
tives,  DT&E  and  OT&E  combine  to  provide  quantitative  mea¬ 
surement  and  qualitative  assessment  of  both  performance  in 


The  authors  can  be  contacted  at  patrick. dallosta@dau. mil  and  tom. 
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DAU  and  Continuous  Learning 

•  Access  to  a  variety  of  self-paced  and 
relevant  continuous  learning  modules 

•  Available  24/7  and  free  to  all  users 

Modules  are  offered  in  the 
following  topics: 

•  Business 

•  Contracting 

•  Engineering  and  Technology 

•  Logistics 

•  Acquisition  Management 

•  Program  Management 

For  more  information,  visit  http://clc.dau.mil 
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